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ABSTRACT 

Tmo studies vere conducted to determine the 
usefulness of the Sampling Organization and Recall through Strategies 
(SORTS) test and the effectiveness of teaching grouping strategies to 
young handicapped children (mean ages 9 and 6 years). In both 
studies, SORTS was used to develop &r.d implement instruction in 
orgarizational strat':»gy. In the first study, analysis of pre- and 
posttest scores indicated that the Ss (29 educable retarded students) 
increased their use of associative functional grouping and improved 
their recall ability after the training. The 28 children enrolled in 
transition classes in the second study received either associative 
grouping instruction (experimental group) or training in art 
techniques (control group) . Results of pre* and posttest SORTS scores 
indicated that only the experimental group increased their use of 
associative groupings. Results of the two studies suggested that the 
test vas a useful tool to assess and plan instruction in functional 
grouping strategy for young normal and handicapped children. (Three 
appendixes provide information on administration, directions, scoring 
and coding the SORTS.) (CL) 



ERIC 



RESEARCH REPORT #37 

Project No. 332189 
Grant No. OE-09-332189-4533 (03?.) 



U» OirAMTMiMIOrHiAtTR 
NAnOMAi iWlTltUtt O? 

1M1\» DOCUMUNT HA^> ftlifeN Wf-PHO 

Al»Non l>D»>*1iO^ V^t*tOW OP^N^ONS 



MEASURING EDUCATIONALLY HANDICAPPED CHILDREN'S ORGANIZATIONAL 
STRATEGIES BY SAMPLING OVERT GROUP INGSl 



R. Hunt Rlegel 
University of Minnesota 



Research, Development and Demonstration 
Center in Education of Handicapped Children 
University of Minnesota 
Minneapolis, Minnesota 



May 1972 



The research repo«-ted herein was performed pursuant 
to a grant from the Bureau of Education for the Handi- 
capped, U.S. Office of Education, Department of Health, 
Education, and Welfare to the Center of Research and 
Development in Education of Handicapped Children, 
Department of Special Education, University of Minnesota, 
Contractors undertaking such projects under government 
sponsorship are encouraged to express freely their 
professional Judgment In the conduct of the project. 
Points of view or opinions stated do not, therefore, 
necessarily represent official position of the Bureau 
of Education for the Handicapped. 



Departuent of Health, Education and Welfare 
U. S. Office of Education 
Bureau of Education for the Handicapped 



2/3 




IN iiDucATiorj or hau»d;ca}'pi:d children 



f'iitli.'- Hnll. University of MmncnoKi. Minno;ipolis, Minfiosota 5£»4b5 



The University of Minnesota Re«uarch, Dovulopment and Demonstration 
Cent or in Educat ion of Handicapped Children has been established to 
couctntratt* on intervention strategits and njatcrials which d«2velop and 
Iraprovo language and comisunication skills in young handicapped children. 

The long lonn objective of the Center is to improve the language 
and v-oranumicntion abiliries of handicapped children by means of idcn- 
tificntioii of linguistically and potentially linguistically handicapped 
childit-n, development and evaluation of intervention strategies with 
yov;ng har.diw-apped children and dissemination of findings and products 
of benotit to young handicapped children. 
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Measuring Children's Organizationaa Strategies 
by Sampling Overt Groupings 

R. Hunt Riegel 
University of Minnesota 

Overview 

Many inferences derived from adult studies about children's 
memory abilities have been based on assumptions of quantitative 
differences due to age. Anlevelopmental perspective^ however, empha 
sizes qualitative differences^ and should be considered 
more carefully if applied researchers are to make educationally 
relevant recommendations regarding school curricula. This papei 
will consist ot a brief review of research trends in the area of 
organization and memory, discuss their relevance to the study of 
children's processing abilities, and suggest a possibly useful 
tool In the application of knowledge about information processing 
to the educational experience of the child. While major implications 
will be addressed to the field of learning in handicapped children, 
it Is suggested that young normal children may also benefit from 
such applications. 

In the field of information processing, a great deal has been 
written in support of an information-reduction hypothesis for 
increasing learning ef fectiveness* Limits on adult processing 
abilities have been specified (Miller, 1956) and refined (Mandler, 
1967)^ and suggest that some form of organizational strategy must be 
activated in order to overcome the demands made on memory by large 
amounts of information • This notion has given rise to numerous 
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theoretical und research papers (c,f»^ Tulvlngj 1968)» in which 
tvpcs of orK«niJsation have been specified (e.g., primary^ eecondary) 
and studied, using adult subjects • Generally such studies have con*^ 
cludad that an association between Items must be made, either 
temporally or conceptually, if recall is to be enhanced. 

Another activity related to recall recently receiving 
much attention is the phenomenon called "clustering" by 
Bous field in 1953. In studies related to this phenomenon^ recall 
protocols have been analysed to determine the consistency with which 
recalled Items appear adjacent to each other over trials. Again, 
the majority of these studies have been conducted with adult subjects. 
Hcnoral izAt ions based onsuch studies regarding the nature of memory 
tail to take into account possible qualitative developmental differ- 
ences. To restrict the study of memory and recall-^related factors 
to adult subjects who have already developed organizational schemes 
for processing Information is to ignore the nature of the means by 
w.iich those schemes developed, and limits our ability to apply 
knowledge about information processing to learning in the formal 
educational context. Modifications of the clustering studies for 
use with children have b«en made (cf. Stephens, 1964), but they 
continue to emphasize only recall variables, holding input presentation 
constant or under the careful control of the experimenter. The 
study of organizational factors related to learning and retention in 
children must encompass both developmental trends in oro:ani zational 
processing at input and organizational factors at recall. Thus, if 
educationally relevant recommendations are to be made, the relationship 
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between input and outp\it variables must be better specified. 

There is much evidence to suggest that children's organizational 
schemes differ qualitatively from one developmental stage to the 
next (cf.» Inhelder & Pxaget> 1959; Kuhn> 1972). It also appears that 
the kinds of organising operations observed at a given time may allow 
inferences about the underlying conceptual scheme determining their 
form. Generally these schemes are seen to change from perceptually 
determined collections of items to hierarchical groupings. From an 
information reduction point of view (as espoused by both Miller and 
Handler) chese qualitative changes may be seen as progressing 
toward increased competence in both organizational effectiveness and 
related output (recall) efficiency • Unfortunately, studies related 
to the identification of organizational schemes in children have 
typically focussed on the type of relations found by children in a 
set of experimenter-imposed groups. As in adult studies of recall, 
and in modifications of those studies for children, studies of organ*- 
ization*:l factors have typically focused on either acquisition or recall 
variables of the learning process, but not both simultaneously. For exampl 
Bruner and Olver (1963) have obtained a wealth of data regarding 
age differences in the kinds of relations found between sets of 
experimenter- imposed items, but have stopped short of collecting 
recall data relevant to those relations. Kuhn (1972), too, has 
substantiated in part the stages of grouping behavior specified by 
Inhelder & Plaget (1959), again without pursuing the question of the 
effects of the differing grouping schemes on recall. It would 



upptiar that Jiuch situdieSi although providing valuable information 
tip«cltic to the questions they are askings tend to suffer from 
a kind of rigidity, in that they consistently fail to associate 
input factors (e»g.» classlflcatc dehavlor» grouping strategies, 
transformations) and output factors (e»g*t clustering, total recall). 
It is (Suggested here that the two can and should be related In 
roeaningt'ul ways. 



By the age of six years, children entering the mainstream of 
education are exposed to a wide variety of activities in which 
information processing and remembering are essential. Often, however, 
children of this age group have not fully developed the cognitive 
abilities prerequisite to efficient processing skills. For example, 
thev may be slow to develop the ability to decenter or attend to 
associatlcns between several stimuli simultaneously. Many young 
children will tend to "center" or attend to a single dominant 
attribute of a stimulus, and to find perceptual characteristics of 
items (e.g.» color, si<fi;e) more salient than intrinsic or more 
tunctional dimensions (cf. Bruner & Olver, 1963). Functional aware- 
ness of their own thought processes, too, is still unavailable for 
planful learning in most young children (cf. Flavell, Friedrlchs & 
Hovt, 1970). While there is evidence from several sources that 
young children do in fact utilize some form of organization, albeit 
Inefficient, in processing a set of stimuli (Rossi 6 Rossi, 1965; 
Moelv, £t jal • , 1969), an awareness of the organizing process for 
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Intantloaal memorUastlon is not evident. Theie kinds of 
dlft'lcultiea may be even more extensive In children identified 
m mentally retarded than in young normal children. 

Retarded children have frequently been described as inefficient 
learners, although there Is evidence that associations, once formed* 
tend to be fairly durable in these as well as normal children (cf . 
Bauraeister, 1967). The problems encountered by the retarded are 
muHt frequently associated with acquisition phases of learning, and 
have been related to Inefficient learning habits (Osborn, 1960; 
lano, 1971) or to poor conceptual skills (Stephens. 1966). Studies 
investigating the kinds of associations generated by retarded 
children have consistently shown that they identify and use fewer 
functional relations, and more perceptually-based groupings (cf., 
Stephens, 1966; Stacey & Portnoy, 1951; Spitz, 1966). If such 
findings are to be utilized for the improvement of educational 
practices. Instruments must be developed to accurately diagnose 
the kinds of strategies EMR children employ during acquisition, 
and to suggest possible Intervention programs for enhancing those 
strategies. One such measure is described here. The Sampling 
Organization and Recall through Strategies ( SORTS ) test has 
been designed to diagnose specific levels of associative abilities 
In children in such a way as to prescribe appropriate educational 
Interventions to enhance the use of conceptual strategies. 



Construction of the Test 
Thare are a«varal aBsuaptlonB which have been nade in the 
development of this instrument for asHeasing the organicaLlon«l 
ab lilt lea of young children: 

1. 'I1ie raeaaure should allow spontaneity on the part of the 
subject in selecting grouping strategies. 

2. The measure should take into account young children's 
unfamiliarity with written symbols. 

3. A variety of associations should be possible for the child 
In order to determine his relative ability to group an array of 

4. The child should bo given an opportunity to understand 
what Is expected of him before statements can be made 
regarding his ability to generate grouping strategies. 

5. The effects of rote rehearsal should be mlnlmiied if group- 
ing strategies are to be meaningfully related to recall data. 

6. The effects of novelty of the items on the measure should 
be minimized, so that confounding recall with degree of original 
learning may be avoided. 

In conHideration of these assumptions, the construction of the 
instrument has taken the following form: 

Instructions preclude the examiner's giving any cues or 
relntorcements for particular kinds of sorts, so that subjects 
are encuuraged to generate their own groups. 

2. Items are presented pictorially to avoid children's inability 
to rend their names. 

3. Items have the capacity for a wide varisty of associations as 

12 
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wull dt» coiwentiunal catngoriciil rclationa* 

A, A propertv of color which is independent of tha item Itself 
includ«d to allow toi* sorting airing a perceptual dimension which 
would nut hkt confounded with other » higher-level sorts. 

Hu* total nunber of Itema in sorts requiring recall 
large enough to avoid ceiling affects, yet small enough not to 
overwhelm the subjectn. 

h, Itemn Hi.^li«cied tor the tebt are coinnon animate and 
inanimate objecin lor which the child can supply a name. The 
tefit, when conn true ted with these factors in mind, is thus pre- 
rtenced in ItB current form: 

1. Adminiatration instructions have been developed which 
standardize procedures related to stimulus presentation and which 
specif V Htandard prompting procedures for minimizing unintentional 
cueing (See Appendix At). 

2. Specific directions for the test in the form of verbatim 
Instructions for the subject and procedural instructions for the 
examiner, have been developed to standardize administration 

(See Appendix B.). 

3. A scoring sheet has been developed for rapid scoring of 
grouping responses and in which specific Information related to 
the child's sorting performance may be readily recorded (See 
Append ix ) ♦ 
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Vhv Sa>HTS tent U c»>^posed of four dlstTnci parts. In the 
iirHt» the child is asked nlmply to put plcturcb together the way 
he thlnkn la hest, and to give his raaaona for the groups • The 
instruct ionb .irc optMi-ended with the aim of ^liciting a reasonable 
esitiiKation of what the child does tipontaneously in such a situatJnn. 
The second part is a repetition of the first, but with explicit 
inntruc t ions to ijearch for Birallaritiea between the items ('*Put the* 
onus tugother that you think are the same'')^ These first two sorts 
luntaln unlv 12 Itemn, and serve not only a6 diagnostic measures 
but ,iKsi> as warm-up activities to the more important sort 3. No 
recall in required, and children seem quite willing to attempt to 
orvvinize this i^mall set. The third part, however, does require 
recall, Mid so Includes 20 items. In this sort, the items are 
chvinged from animals to common inanimate objects. This shift, along 
with sWtering the spatial array of the itews at presentation, is 
intended to reduce the possibility of interference of the first two 
si>rt« on the recall of the third. Following his grouping and a 
rt*i\ill period, the subject is again asked his reasons for the par- 
ti euKir ^iroups he made. The fourth part of the test is intended 
tor .ukun ist rat ion only after the child has made lUs own groups and 
recalled from them. In this part, the experimenter arranges the 
20 pictures used in the third sort into the categories specified on 
the scoresheet (Ke,, things that grow, things that make noise/ 
music, furniture, transportation, things to live in). He then asks 




Lhe iiubjttct to give the reasons he thinks are appropriate to the 
groups tormed, and again asks for recall. Typically this fourth 
part ha- been used only in posttesting In the studies t;e have run, 
in order to avoid contaminating the spontaneous generation of 
>7,roups in onrller sorts. If used as a diagnostic instrument, 
however, this part should be included in ail cases. 

An extensive review of previous literature concerned with con-- 
ceptual development and developmental sorting differences and much 
field observation have led the writer to a five-point scoring system 
which describes the relative level of grouping strategy employed by 
young rhlldren. Specific scoring criteria are reproduced in Appendix 
D» and describe the kinds of sorts likely to occur, rather than 
implying values • While it has been found that levels 1 and 2 sort., 
(syncretic and jerceptual) have consistently been related to under- 
achievers, retarded, or very young children, all higher-level 
associative responses should be devoid of implied judgmental value. 
Idiosyncratic associations, for example, may be quite different 
from conventional categorical sorts, yet may have great mediational 
value for the individual. Indeed, several writers have cautioned 
against the fallacious belief that conventional categories are 
"better** than elnborative contexts or other kinds of rich mediational 
strategiivs (cf. Bussis & Chittenden, 1970). It would seem that 
judgments about the value of a particular kind of grouping must be 
postponed until the usefulness of the <roup for recall can be 
determined. To this end, the SORTS test yields three major scores 
for describing the child's performance: 

10 



10 

1. The tlrBt score represents an index of the sorting level 
demoni^trated by the child, obtained by means of a weighted 
average of items grouped in particular ways* This index Is 
derived for each of the four sorts in the test. The score 

is comprised of a combination of three sources » including the 
;uuual groups formed by the subject, his verbalized reasons 
for those groups, and the experimenter's judgment, should 
the child's reasons be discrepant with his groups. 

2. The second score is the number of correctly recalled items in 
sorts three and four, obtained by simple counting of verbatim 
records taken during the recall phase* 

}. The third major score is an index of clustering, providing a 
measure of the extent to which recall organization corresponds 
to the organization observed during the Input phase. In sort 
three, this index ir» derived by comparison of recall order with 
the groups the child made. In sort four, the index is derived 
bv comparing recall order with the experimenter's groups. 
While these three scores comprise the major informational data 
for analysis, there are several other factors which are available 
for study. For example , the total number of groups represented 
at recall and the average number of words per group at recall are 
two such factors. For our purposes in this paper, however, we 
shall limit our discussion to the three major data sources, to which 
we now turn for more detailed description. 
1. The weighted average. 

In order to assess the way in which a child approaches the problem 
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ot soriing an entire array of pictures » an index was developed 
which would reflect in a single score both the extent to which 
all itemn were considered and the relative extent to which inclusion 
and exclusion rules were used. To this end, a weighted average 
based on the number ot items grouped at each level was devised. 
The number of pictures the child placed into each group was weighted 
bv the number assigned to the kind of group he formed, according to 
the .specifications in Appendix D. An average score for the entire 
array was then taken by dividing the sum of the individual group 
scores by the total number of items in the array. The formula used 
to derive this index, while losing information about specific grou,)S 
made, has the advantage of providing a general summary of the child's 
relative proximity to efficient information-reduction groupings. 



Specific items recalled were assigned index markers corresponding 
to the groups made by the child. These indices were used in an 
analysis of runs, which constitutes the basis for the clustering 
score described in the next section. Total correct recall was 
counted, excluding repetitions. Intrusions were treated separately. 
Analyses of recall were made both in terms of group means and by 
iroquency counts of subjects recalling more than eight items 
correctly, and those recalling eight or less. These ranges are 
based on the short term memory expectations defined by Miller (1956), 
modified to account for the slightly lower recall scores (cf. Nelson, 
1969) observed in young retarded children. Thus frequency analyses 
ot recall datp were made around the expected short term memory range 
of 6^2. 



Recall 
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3. The Clustering Indnx. 

This index, based on runs theory for which statistics have been 
developed (Mood, 1940) «nd modified (Wall is & Roberts, 1957), has 
been adapted for u«e with recall data by Frankel and Cole (1971). 
Their paper presents a thorough analysis of the various clustering 
indices in use, and is recommended for readers Interested In this 
aspect of organizational analysis. Basically, the index derived is 
a z - score representing the difference between the observed number 
of runs of items from j categories and the mean number of runs occurring 
by chance in a list length of N items with J categoUes represented, 
divided by the standard dev ation of the number of runs observed. 
The formulae used to derive this score may be found in Frankel & 
Cole's paper, but are reproduced here for the reader's information,^ 
The benefits of this statistic derive from the face that It accounts 
lor chance runs in the recall protocol, and is independent of the list 
length it is used to explain. 



Given the above background, two studies were conducted to determine 
the usefulness of the test and to explore the efficacy of direct training of 
voung children In strategies for grouping. Both studies involved the use of 
SORTS as a dependent variable in the training of young handicapped 
children to Renerate and utilise more efficient, planful strategies 
for organizing materials. A sequence of training activities was 
developed in which skills necessary to the successful utilization 
of a grouping strategy were systematically taught to the subjects over 
a month's time. Pre- and post-test analyses were conducted, and 
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change Kcoroa were evaluated. The following is a sununary of these 
pro jects . 

Study 1: The St. Paul strategies instructional program 

During the hiunmer of 1971 a project was conducted in St. Paul, 
Minnevsota under Title I funding, in which EMR children identified as 
at ioaat one year below expectation in reading and/or math achievement 
were provided a program of basic academic training (Riegcl & 
Taylor, 1971). A second component of this project was the develop-* 
tnt^nt and pilot use of a mnemonic strategies approach to teaching 
organizational skills. A sequence of activities was developed for 
use with the youngest third of this population, and the SORTS test 
was administered to all children in the project as both a pre- 
and post-test measure of organization and recall. This administration 
constituted the first use of the SORTS test on a large scale. 
Subjoc ts 

The sample of children included in the project ranged in age 
from 92 to 177 months (7-8 to 14-9 years C.A.)» While results of 
the entire studv are interesting and show gains for all age ranges, 
the older children changed from pretest to post test primarily in 
recall and clustering c;cores. The sorting levels of these children 
did not change significantly, due in part to the nature of the train- 
ing given them. That is, the older groups were trained in the use 
ot elaboration and imagery processes, while the younger children re- 
ceived direct training in grouping and organizational skills. For 
our purposes in this paper we shall report only the results of the 



19 



lA 

vouuijcr >j;roups. Information regarding the older children may be 
obtained at a later data from the interim report now being completed 
(Tavlor & Riegel. 1972), 

The younger group of children were placed in five classes. Only 
Che children who were given both pre-^ and post-^tests will be dis-* 
cussed here, bringing the sample size of this group to 29. The 
mean chronological age of the group was 110.4 months, with a standard 
deviation of 9 months. The mean I.Q» was 69.5, with a deviation 
of 6.25. The mental age of the sample was approximately 77 months, 
or about 6 1/2 years. 
Metho d 

Children were pretested on the SORTS test in late June and post- 
tested in late July, 1971. In the interim, activities were developed 
and piloted which were designed to improve the child's awareness and 
use or strategies for seeking relations and organizing sets of stimuli. 
The tests were individually administered by carefully tr& .ned testers. 
The results were then scored by the writer. A second scorer rescored 
a later set of data, resulting in an interrater reliability on the 
scoring key (Appendix D) of .94, .89, and .90 for sorts 1-3 respectively. 
Repeated measures t-tests (Ferguson, 1971) were run to assess the 
change in overall grouping level over the one month training period, 
Wlule there were no control subjects available for this study. Study 2 
includes such a group for comparison. 
Res u 1 1 s 

Table 1 summarizes the mean pretest and posttest sorting data 
for the sample, with repeated measures t-test results indicating the 
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HignUioance ot the change over one month. As may be seen, the group 
changed significantly in the direction of using more associative 
relations In g.'ouplng the items (p < .01 in all three sorts). Because 
of the nature of the training, we expected a shift in this direction, 
and so a one-tailed test of significance was used. In this case and 
other repeated measures t-tests for this sample, N-1 degrees of 
freedom were 28, where N is the number of pairs of observations. 
While the average sorting level increased only about .5 levels on 
the posttest, this shift Indicates that significantly more items 
were associated functionally by the children on the posttest than on 
the pretest. 



Insert Table 1 here 



Because specific information regarding the kind of sorts obtained 
i« lost through combination of the weighted averages over the entire 
sample, frequencies of responses at each of three levels of organi- 
zation are reported In Table 2. Intervals of scores in this table 
correspond to sorts which are primarily syncretic In nature (A), 
perceptual (B) or associative (C), indicating a trend from no apparent 
stratepv for grouping to more planful rules for associating items. 



Insert Table 2 here 



As mav be seen, in the first two sorts, there is a distinct trend 
from perceptual sorts toward more associative groupings, with seven 
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chiUren more ialling In the associative range at posttest. On 
«ort 3, In which the array is slgnlf icantlv larger, the shift 
is more from a failure to generate an effective grouping strategy 
on the pretest to sorting at least by perceptual attribute on 
the posttest, no fewer than 10 children demonstrating this gain. 
A graphic representation of these shifts is provided in the histo- 
gram in Figure 1. 



Insert Figure 1 here 



It is evident from these data thiJt the children in this sample 
shifted toward more functional levels of grouping strategies. The 
recall data shows a corresponding increase in both quantity and 
cluhtering quality on the posttest. Given the range of 6+2 dis- 
cussed earlier as an expected short term store for Individual items, 
we shall present here the frequencies of children falling either 
within or beyond the limit of 8 items defined by this range. Table 3 
presents these frequencies in terms of total number of items recalled 
correctly on both the pretest and the posttest. The Increase of 11 
children recalling 9 or more items is a sound indication that indeed 
the children were recalling more effectively following the training 
period. 



Insert Table 3 about here 
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The means, standard deviations and significance of these data are 
sununarized in table 4, A difference of nearly two items recalled 
on the posttest yields a t of 3.012, significant beyond the .005 
; level on a one-tailed test with 28 degrees of freedom. On the 
pretest It may be seen that on the average the children were 
recallinK within the limit postulated for short term store, while 
the posttest data indicate an average recall beyond that limit. 
Thus tho shift toward more effective strategies is readily evident 
in the recall data. 



Insert Table 4 about here 



Clustering of items at recall, too, reflects this shift toward more 
efficient strategies on the part of the children in the sample, 
although these data are less dramatic than either the sorting or the 
recall data. Taking a Z-score of 1.96 as an indication of significant 
clustering beyond the .05 level. Table 5 summarizes the number of 
children falling above and below this level. While only 3 children 
changed in the significance of their clustering a stronger trend 
toward increased use of the groups as mediators may be seen more 
clearly in the next study, in which a direct association between 
grouping operations and remembering was made. 



Insert Table 5 about here 
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Study 2: The Rosevilic project. 
Subject s 

This •tudy, in part a replication of the training sequence study 
described in Study 1, comprised two "transition" classes of children 
Judged not ready for successful first grade placement. Twenty-nine 
children were included, but one subject was dropped from the sample 
due to extreme hyperactivity and behavioral disorders. The mean age 
of the sample was 78 months, with a standard deviation of 2.7. The 
mean l.Q. was 100.5, with a standard deviation of 9. A. This sample 
is younger than that of the previous study, although there is little 
difference in the average mental age of the two samples (the M.A, in 
months of the Study 2 sample being 78 months, and that of Study I 
being 77 months) . 

Subjects were randomly assigned within schools to each of two 
conditions. The experimental groups received training in grouping 
strategies for 1/2 hour dally for 4 weeks. The control group was 
given training in art techniques for a comparable amount of time. 
Pretesting consisted of the first three sorts of the SORTS teat, 
while posttesting included all four parts. This study Included the 
first use of the fourth sort in a controlled experimental situation. 

Resul ts 

The results of pretest and posttest data collected for the two 
groups are summarized in Table 6. Similarities may be seen between 
the trend indicated by these data and those of Study 1. The experimental 
group showed a distinct shift (again of approximately ,5 levels) 
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toward more asrtociatlve groupings, while the control Rroup showed no 
Kuch change. Repeated measures t tests indicate significant change 
for the experimental group beyond the .05 level on all three sorts 
on onc~tailed tests with 13 degrees of freedom (N-1 - 13 where N 
Is the number of paired observations). 



Insert Table 6 about here 



Table 7 presents a frequency of occurrence »ummary of subjects sorting 
at syncretic (A), perceptual (B), and aftsociative (C) levels. The 
trend reflected in the above scores is readily evident In the change 
in nuraborti of children sorting at higher levels for the experimental 
condition, particularly in sorts 1 and 3, in which four subjects 
moved toward associative grouping from syncretic and perceptual^ 
levels on the pretest, while no such shift is seen for the control 
subjects . 



Insert Tabel 7 about here 



In general, it appears that a proportionately higher number of 

the experimental group were using associative strategies on ihe post 

test than were the control subjects. 

The recall data, too, reflects this shift, but in this case the 
differences in mean scores are not as striking. On the pretest, 
the control subjects recalled an average of 5.97 items, while the 
experimental subjects recalled nearly one item fewer (with a mean of 
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5.0), On the posttest, both group* recalled the samo mean number 
of item» (6.6). The differences between the groups Is evident In 
their change scores, however, with a repeated neasures t for the 
control group of 0.785 (p < .50). and the experimental group of 2.126 
(p * .05). Although subjects were randomly assigned to treatments. 
It was discovered after the training had begun that a disproportionate 
number of experimental subjects were rated as impulsive on the MFP 
acalo (Kagan. 1965). While only 2 of the 14 control subjects were 
classified as impulsive, no fewer than 7 of the experimental group 
were so classified. We take this apparent difference in the groups 
at pretest to be a partial explanation of the pretest recall differences 
observed , 

Real differences between the groups appear in the breakdown of 
recall data into subjects recalling more than 8 items, however. 
Table 8 presents these data, in which it may seen that, while there 
was no change In the number of control subjects recalling more than 
the hypothesized short term limit (there being 3 on both testings), 
there is a net gain of six subjects falling in the upper group from 
the experimental sample. 



The number of children clustering significantly at recall 
corresponds to this shift, as simanariased in Table 9, While only 
one control subject changed in the significance with which his recall 
corresponded to the groups he made on sort 3, four of the experimental 



Insert Table 8 about here 




ERIC 



ttubjecta tihowed this shift. This difference provides support for 
the notion that at least some of the experimental group were learnlnR 
to uHe uroupinR strategies more effectively for r..>m«mberlnR. 



Insert Table 9 about here 



Tht'Hf data, considered along with those of Study 1, lend strong support 
to the hypothesis that there are systematic changes occurring on the 
SORTS test In response to training >oung children to generate and use 
grouping strategies. 

The fourth sort, in which children were asked to discover reasons 
for and recall items from groups imposed by the experimenter, was 
administered to both groups at the time of posttesting. The number of 
children identifying associative or categorical relations for the im- 
posed groupK was markedly different for the two groups, as indicated 
In Table 10. In the control group, there was a tendency to either 
discover no associative relation at all or to identify the conventional 
category represented by the items. In the experimental group, however, 
there was a wider range of responses indicating associative relations, 
and far fewer subjects who could not identify any functional relations 
at all (there being only one such subject in this group, but seven 
in the control group. 



Insert Table 10 about here 
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lUtterencea In the recall averages for each group were larger 
than tho«« in sort 3, with the experimental group recalling an 
average of 1.36 UentH more than the control subjects. Th« mean 
recall of the experimental group was 7.64» while the mean of the 
control group was 6.28. This increase from sort 3 to sort 4 In 
recall reflects a generally increased ability on the part of the 
experimental group to utilize organization provided by an external 
source as a mnemonic mediator. A relationship between the subjects* 
recall and the clustering observed becomes apparent at this point. 
Six of the 14 experimental subjects recalled 9 or more items from 
sort 4, while only three of the control subjects recalled in this 
range. Of the six experimental Hubjects, five clustered significantly, 
while none of the control subjects used the groups provided by the 
experimenter as effectively. Table 11 summarizes the mean recall and 
frequencies of clustering for the two groups. 



Insert Table 11 about here 



Discussion 

Tho Ktudios reported here are exploratory. The questions relate 
to the efficacy of a test for measuring chlldrens' organizational 
strategies. Wille it is suggested that the Instrument described is 
appropriate for the assessment of organizational changes in young 
children, the training sequence developed for these two studies is 
but one possible package. In It, the processes Involved in the 
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generation of a grouping strategy have been specified and developed 

for systematic trainina in grouping and remembering skills. Answers 

to ouestlons related to changes in information processing skills in 

children are sought through the SORTS test in terms of both 

qualitative and quantitative indices. 

The data reported above reflect the scores obtained on the SORTS 

t»M;t prior to and immediately following a sequence of training 

activities constructed on the same model. The two studies described 

constitute pilot studies of both the test and the training 

sequence. As such, it is difficult to make definitive statements 

about the test due to the small sample sizes in each study. However, 

there are strong indications that the children in the samples were 

performing better in both organizational grouping and recall following 

training. Although much data is lost by using a weighted average, 

it is evident that children given organizational training in both 

studies increased significantly in their use of more associative 

kinds at strategies (producing a .5 Increase in the mean weighted 

average for both studies). Because the descriptive data fell into 

groups of scores which were too small for appropriate nonparametric 

2 

statistical anlayses (e.g. - X ) , we have reported mainly frequency 
tables. Further studies of the measure currently in progress are 
using larger samples, and should yield more generalizable data. 
However, even from the small data base available, it is apparent 
that significant numbers of children are recalling more and grouping 
more efficiently after even a month of training. There is good evidence 
then, that the test is a useful one, which is sensitive to the 
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assessment of operational schemes generated by young subjects. It 
should be noted that this paper does not purport to report data 
to the end of providing validation information. At this point In its 
development, the SORTS measure is being used to explore the useful- 
nojiti o! Che approach and the kinds of information obtainable. 
Later studies will attempt to provide indices of validity and relia- 
bility for the factors being discussed. 

It Is also clear that training young handicapped children to 
organize material improves their ability to deal with large sets of 
stimuli (20, in this case) planfully, and that such training 
facilitates more efficient recall. The data in support of this 
conclusion are clear; the number of children who did not generate 
a functional strategy for grouping decrease markedly following 
training. In Study 1, for example, children in this category de- 
creased from 13 to 2 on Sort 3 (Table 2), and from 7 to 2 in Sort 1 
of study 2 (Table 7). Children also Increased in the use of strategies 
making use of meaningful associations between items (as opposed to 
attending to irrelevant color attributes). Sorts 1 and 2 of study 1, 
for example, show an Increase of seven subjects finding associative 
relations (Table 2) Sorts 1 and 3 of study 2 shows a like increase of 
four cases employing functional grouping strategies (Table 7). 

Recall data, too, are strong indicators of the usefulness of this 
approach. Studv 1 children increased in mean recall by nearly two 
items (Table A), with an Increase of 11 subjects (more than one third) 
recalling nine or more. Subjects in the experimental group of study 2 
also gained in the number recalling 9 or more items, with six cases 
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(nearly one half) showing this Increase. This Is contrasted with no 
change In the control group (Table 8), Indicating support for the 
efficacy of the training sequence. That such changes In recall are 
accompanied by changes in the grouping strategies employed by the 
subjects suggests support for our assumption that organizational 
processes at input are related to recall effectiveness. Further 
support may be found in the clustering data. Because It is based on 
the extent of agreement between items grouped at input and items 
grouped at recall, we take this score to be an index of the extent 
to which the groupings formed at input facilitate (and render more 
efficient) the subject's recall. There are strong indications that 
in fact such a relationship exists. For example, all but two of 
Che subjects in study 1 who clustered significantly recalled 9 or 
more items, while the other two recalled 8. All but one of the 
subjects who clustered In study 2 recalled 9 or more items. In spite 
of the sample sizes and the relatively short intervention period, 
Che trends observed in all three indices are quite strong, and suggest 
further exploration of the approach. 

It would appear from the pilot data on sort 4 that the differences 
in children's ability to discover and utilize organization imposed 
on material by the experimenter may be identified. Differences in the 
kind of associations found in the materials are consistently related 
to differences In both recall and clustering (Table 11). Children who 
could Identify functional reasons for the groups recalled more of the 
items and clustered them more than those who could not. This finding 
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suKgestsi Chat training in the use of organizational strategies also 
facilitates the use (for mnemonic purposes) or organizAtion supplied 
by an adult. Such a notion would support the concept that organizing 
teaching may be useful for young EMR children, and that teaching such 
children how to use the organization supplied would be even more 
helpful. The results of these studies support both the efficacy 
and usefulness of a strategies approach to teaching. It is possible, 
for example, that the observed changes in organizational abilities 
might transfer to other areas of learning, as has been suRgested in 
studies emphasizing Imagery strategies (Taylor, Josberger & Knowl- 
con, 1971) and verbal elaboration strategies (Turnure & Thurlow, 
1971). Such a possibility, as suggested by these data, lends sup-' 
port to the consideration of revised curricula incorporating direct 
training in the use of strategies for learning, rather than the 
emphasis typically found in special classes on perceptual pro- 
cessing and repetitive presentation of academic content. 

From the studies run, the SORTS test is sensitive to changes 
In organization skills in children up to a chronological age of 9 
years. The promising results of the two pilot studies provide impetus 
for further testing and the collection of normative data on how 
young children organize sets of pictures. The information available 
through this kind of testing may provide us with important data concern- 
ing how children process information. Further, the differences in 
learning abilities between young EMR and young "normal" children may 
become more apparent, enhancing the development of more functional 
cognitive interventions. To date there is a rapidly growing body of 
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Hubjeccive evidence from teachers in the classroom and from observa- 
tionn ot the writer and his coHeaRues that the test has good face 
valldltv and Is reliable, Interscorer reliabilities are strong (all 
in the .89 to ,94 range) , suggesting that the criteria for assigning 
scores to the groupings made by the subjects are reasonably well 
objectified. Current studies will include data on reliability 
between examiners and on test-retest stability. 

Wlvlle there are still numerous problems with the measure to be 
accounted for (e.g., the need for an alternate form, for validity 
data, etc), our preliminary analyses show it to be a useful tool 
in the diaj^nosis of information processing abilities in young 
children. It further provides us with a new perspective on the 
planning and development of educational Intervention, techniques. 



33 



28 



References 



Bauniei9Cer» A. A. (Ed.)* Mental retardation: appraisals education 

an d r ehabl 1 1 1 a 1 1 on . Chicago: Aldlne» 1967. 
Bous field » W. A. The occurrence of clustering In the recall of 

randomly arranged associate. Journal of General Psycholog y t 1953, 

49, 229^240. 

Bruner, J. S. & Olver, R. R. Development of equivalence transform- 
ations In children. Monograph for the Society for Research in 
Child Development , 1963, 28, 125--1A1. 

Ferguson, G. A. Statistical analysis In psycholo^ and education ^ 
New York: McGraw-Hill, 1971. 

Flavell, J. H., Friedrlchs, A. G. , & Hoyt, J. D. Developmental 

changes in memorization processes. Cognitive Psycholo^ , 1970, 
I, 324-340. 

Frankel, F. , & Cole, M. Measures of organization in free recall. 

Psychological Bulletin , 1971, 76, 39-44. 
lano, R. P. Learning deficiency versus developmental conceptions 

of mental retardation. Exceptional Children , 1971, 38, 301-^311. 
Inhelder, B, & Piaget, J. The early growth of logic in the child . 

New York: Harper, 1959. 
Kagan, J. Impulsive and reflective children: the significance of 

conceptual tempo. In Krumboltz, J. D. (Ed.)» Learning and the 

educational process , Chicago: Rand McNally, 1965. 
Kuhti, Deanna. Mechanisms of change in the development of cognitive 

structures. Child Development , Sept. 1972 (in press). 




29 

Mandler, 0. Organization and memory. In K.W. Spence & J.T. Spence 
(Eds.)t The psychology of learning and motivation . Vol. 1. 
New York: Acadmlc Press, 1967. 

Miller, G. A. Hie magic number seven, plus or minus two: some limits 
on our capacity for processing Information. Psychological 
Kt'view . 1956, 63, 81-97. 

Moelv, B. E., Olson, F. A., Halwes , T. C, & Flavell, J. H. Pro- 
duction deficiency In young children's clustered recall. 
Developmental Psychology . 1969, 1^ 26-34. 

Murakawa, N., & Pierce-Jones, J, Thinking and memory of underach levers. 
Psychologla . 1969, 12, 93-106. 

Nelson, K. J. The organization of free recall by young children. 
Journal of Experimental Child Psychology . 1969, 8, 284-295, 

Osbom, W. J. Associative clustering in organic and familial retar- 
dates. American Journal of Mental Deficiency . 1960, 65, 351-357. 

Riegt'l, R. H. & Taylor, A. M. Teaching basic acadenic skills to 
handicapped, disadvantaged pupils through use of cognitive 
learning strategies. Unpublished paper. University of Minnesota, 
1971. 

Rossi, E. L., & Rossi, S. I. Conceptualization, serial order, and 
recall In nursery-school children. Child Development . 1965, 
36. 771-778. 

Spitz, H. H. The role of input organization in the learning and 

memory of mental retardates. In N. R. Ellis (Ed.), International 
review of research in mental retardation . Vol. 2. New York: 
Academic Press, 1966. 



33 



30 

Scacey, C. L. , & Portnoy, B. A study of concept fonnatlon by means 
of the object sorting test with subnormals. American Journal 
of Mental Deficiency. 1951, 56, 169-173. 

Stephens, W. E. A comparison of the performance of normal and sub- 
normal boys on structured categorization tasks. Exceptional 
Children . 196A. 30, 311-315. 

Stephens, W, E. Category usage by normal and mentally retarded 
boys. Child Development . 1966, _3It 355-361. 

Stephens, W. E. Category usage of normal and subnormal children on 

three types of categories. American Journal of Mental Deficiency . 
1966, 71, 266-273. 

Taylor, A. M. & Rlegel, R. H. Memory strategies in the classroom: 
the St. Paul strategies instructional program. Unpublished 
paper. University of Minnesota, 1972. 

Taylor, A. M. , Josberger, M., & Knowlton, J. Q. Mental elaboration 
and learning in retarded children. Research report No. 22, 
Research, Development and Demonstration Center in Education of 
Handicapped Children, University of Minnesota, 1971. 

Tulvlng, E. Theoretical issues in free-recall. In T. R. Dixon & 

D. L. Norton (Eds.), Verbal behavior and general behavior theory . 
Knglewood Cliffs: Prentice-Hall, 1968. 

Turnure, J. E. & Thurlow, M. L. Verbal elaboration and the promotion 
of transfer of training in educable mentally retarded children. 
Research report No. 25, Research, Development and Demonstration 
Center in Education of Handicapped Children, University of 
Minnesota, 1971 



WallU, W. A., & RoberCB. U. V. Sf tlatlca: A new approach * 
New Yoi'k: Free Press of Glencoe» 1957* 



ERIC 



31 

Footnotea 

An earlier version of this paper was presented at the annual meeting 

of the American Educational Research Association, Chicago, April 7, 

1972. Copies of the SORTS test and the organisational strategies 

training sequence mentioned herein are available by writing to the 

author at the following address. Please specify which materials 

are desired* R. Hunt Riegel 

Research, Development and Demonstration Center 

in Education of Handicapped Children 
Room 5, Pattee Hall 
University of Minnesota 
Minneapolis, Minnesota 55455 

The work described in this paper was supported in part by a 

grant from the Bureau of Education for the Handicapped, U. S. 

Office of Education to the Research, Development and Demons tra-* 

tion Center for the Education of Handicapped Children at the 

University of Minnesota (#OE^09-332189-4533 (032). The author 

wishes to acknowledge the valuable assistance given him on the 

development and critical evaluation of the instruments described 

herein by Dr. Arthur M. Taylor and Fred W« Danner, and to Dr. Donald 

F. Moores and Dr. James E. Turnure for their critical reading of the 

earlier drafts. Thanks also to the many people who contributed 

their time and interest to the standardised collection of data 

reported in this paper. 

Formula for computing a weighted sorting score: 

S • ^^'^j'^j^* where S is the subject*s sorting score, N is the 

N total number of items presented, is the number 
of items in each group, and L is the weight specific to each of 
the J groups. 

38 
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A. Formulae U8«id in computing clustering index: 

^ IIL- ^ where Or Is the observed number of runs in a 

given recalled list, Mr is the mean of the 
normally distributed number of runs for list length N, derived 
by the formula Mr - N(N+1) -^jNj^. and Vr is the variance 

N 

of the observed number of runs, calculated by the formula 



N^)N-1) 
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Figure 1 



33 



Hi»CQgram showing frttquencles of scores represenclng 
no funccional strategy for grouping (A), perceptual 
groupings (B) and aasoclatlve groupings (C) for pre- 
and post- teat data» Sorts 1-3. 



1*. . 



Pretest 

No. subjeccs c- 
aorcing at 
each level 



ABC 

Sort 1 



ABC 

Sort 2 



ABC 
Sort 3 



Post test 
No. subjects 
sorting at 5 
each level 



ABC 
Sort 1 



ABC 

Sort 2 



n 



ABC 
Sort 3 
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Table 1 



Means, standard deviations and t scores for 
pretest and postteat data; sorts 1 •> 3, 



Sort 1 Sort 2 Sort 3 



Pretest X 


1.971 


2.106 


1.952 


(sd) 


(.657 


(1.099) 


(.925) 


?osttast X 


2.538 


2.672 


2.. 


(sd) 


(1.048) 


(1.227) 


(.706) 


• 

t 


3.348 


2.590 


2.474 


(28 d.f.) 


(p < .005) 


(p < .01) 


(p < .01) 
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Table 2 

Frequencies of tubjectt showing no functional 
strategy (A), perceptual groupings (B) and 
associative groupings (C) for sorts 1-3. 



Sort 1 
ABC 



Sort 2 
ABC 



Sort 3 
ABC 



Pretest 



6 18 5 12 8 9 13 7 9 



Post test 



4 13 12 6 7 16 2 17 10 
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Table 3 

Subjects recalling at each level; sort 



Pretest Posttest 





0-8 


24 


13 


of items 








recalled 


9-20 




16 


5 
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Table 4 

Means » scandard deviations and t scores 





tor recaxx aaca{ sore j> 




Pretest Post test 


Recall X 


6.621 8.552 


(«d) 


(3.029) (2.923) 


t 


3.012 


(28 d.f,) 


(p < .005) 
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Table 5 

Frequency of clustering at .05 level 
( 2 > 1.96) 



Pretest Posttest 



No clustering 


25 


22 


Clustering 


4 


7 
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Table 6 

Study 2 means, standard deviations and t scores 
for experimental (E) and control (C) subjects; 

sorts 1-3. 



Sort 1 Sort 2 Sort 3 





E 


C 


E 


C 


E 


C 


Pretest X 


1.673 


1.643 


1.922 


1.482 


1.754 


1.461 


(sd) 


(.499) 


(.676) 


(.770) 


(.476) 


(.608) 


(.511) 


Post test X 


2.451 


1.774 


2.310 


1.566 


2.354 


1.418 


(sd) 


(.877) 


(.651) 


(.873) 


(.828) 


(1.078) 


(.471) 


t 


4.073 


1.095 


2.270 


.358 


2.148 


-.279 


(13 d.f.) 


(p . .001) 


n.s . 


(p <.025) 


n.s. 


(p <.05) 


n.s . 
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Table 7 

Study 2 frequencies for E and C groups showing 
no functional strategy (A), perceptual groupings 
(B) and associative groupings (C)^; sorts 1-3. 







Sort 


1- 


Sort 


2 


Sort 


3 






E 


C 


E 


C 


E 


C 


Pretest 


A 


7 


7 


5 


7 


4 


8 




B 


6 


5 


7 


7 


9 


6 




C 


1 


2 


2 


0 


1 


0 


Post test 


A 


2 


5 


3 


9 


4 


9 




B 


7 


8 


7 


4 


5 


5 




C 


5 


1 


4 


1 


5 


0 
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Table 8 

Study 2 subjects recalling at each 
level; sort 3. 





Experimental 
group 


Control 
group 


r re test no< 
of Items 
recalled 






0-8 


14 


11 


9-20 


0 


3 


Post test 
items 
recalled 

0-8 


8 


11 


9-20 


6 


3 



Table 9 



Study 2 frequency of clustering beyond 
.05 level of significance; sort 3. 



Exper. 



Control 



Pretest no 
clustering 


14 


13 


Clustering 


0 


1 


Post test no 
clustering 


10 


12 


Clustering 


4 


2 
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Table 10 

Study 2 sublects identifying no relations (A), perceptual 
relations (B) and associative relations (C) between items 
In experimenter- Imposed groups. 



Experimental 
group 



Control 
group 



B 




DO 
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Table II 



Study 2 recall and clustering in sort 4 
for experimental and control groups. 



Experimental Control 









Recall X 


7.64 


6.28 


(sd) 


(4.16) 


(3.29) 


No 






clustering 


6 


11 


Clustering 


6 


3 
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SORTS Administration 

Order — The first and second sorts Involve nanlpulation of the sane 
set of stimulus cards. The third sort requires a different set. The 
cards are numbered onthe back for order of presentation, and should 
be sequenced numerically for each administration. Thus the cards for 
sort 1 whould be reordered prior to presentation for the second sort. 
The cards used In sort 3 are again used in sort 4, but the experimenter 
sorts them Instead of the child. 

Array — Sorts 1 and 2 are to be arranged in a circle, with each numbered 
card placed in Its corresponding position on the fact of a clock. That 
is, card #1 (alligator) goes in the 1:00 o'clock position from the child's 
perspective, card #2 in the 2 o'clock position, and so on clockwise to 
12. 

The third, or test, sort is arranged in four rows of five cards 
each, ■ovIph from left to right and from top to bottom. Sort 4 is 
arranged by E in five rows of four cards each, corresponding to the 
categories specified on the scoring sheet. 

Seatiay — The experimenter should sit at a right angle to the subject, 
with his scoring sheet on a clipboard. The bcirlng sheet should not be 
visible to the child, although its contents are not meant to be a 
secret should an inquisitive child ask. Stimulus cards which are not 
currently In use should be out of the subject's sight. 
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A. Familiarity — Prior to administration of the SORTS, the experimenter 
should have memorized the matrices for recording specific groups. He 
should know which color group correBponds to which row on the motrix 
and which category corresponds to which column. 

Memorization of the specific instructional protocol is essential, 
as well as facility with alternative directions. 

5. Prompting — (A). Names. Should a subject not be able to name a 
stimulus card, the experimenter should supply the name and have the 
subject repeat that name before the next card is displayed. 

If the subject gives a name for a card which also applies to 
another of the stimulus cards, the name should be corrected, and the 
subject should repeat the corrected name. Example; if 'owl' is 
call. 'bird', the experimenter should say, "Let's call this an 'owl'. 
What is this?" (Subject response: 'owl'). Thus the experimenter 
must insure that no two stimulus cards in the same sort are given the 
same name. 

Inappropriate Names (such as 'cat' for lion or 'dragon' for alli- 
gator) are admissible, but should be noted in the matrix beside the 
corresponding name. 

(B). Sorts. One (and only one) prompt is allowable in demonstra- 
ting what is meant by putting things together in piles. This should 
be used only if it is evident that the subject does not understand what 
he is to do. It should be done only with the duck (card #3) and only on 
th« first sort. And it should be done in the following way: Allow 15 
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seconds for scanning before determining that the subject will not 
group the cards. If he »tlll doesn't seem to understand, prompt: 

Move the duck to the rifht of the conf iRuralion and say: 

"See this picture? See if you can find some other ones 

that go with It." 
Again, this raav be done only on the above conditions. 

(C). Reasons. If the reasons a child gives for his groupings 
are so ambiguous as to give little insight into his meaning, say: 
"Tell me more about that." Example situations: initial reason is 
•they're the same", "they look alike", or "they go together." 

Clinical Latitude — Reared number 4 above concerning familiarity. 
It Is suggested that the directions be given verbatim, but modification 
of the wording is permissible at the experimenter's discretion in 
eliciting individual children's grouping responses. Rapport with 
the subject should be established prior to thi» beginning of the test 
rather than during the testing situation. 
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APPENDIX C 
S.O.R.T.S. SCORING SHEET 



Name 
Age 



51 



M / F Date: 



Examiner 



Sort 1 



(red) 


(land) 
DOG 


(water) 
ALLIGATOR 


(air) 
BIRD 


(white) 


COW 


FISH 


TURKEY 


(blue) 


SQUIRREL 


SEAL 


OWL 


(yellow) 


LION 


FROG 


DUCK 


Reasons: 

1. 




Comments: 








— 




3. 








4 








5 








6 




■ - — 




Centering? 
Y / N 


Syncretic? 
Y / N 




Post-hoc reasons? 

V / M 


Difficulty understanding? 
Y / N 


Sort 2 








(red) 


(land) 
DOG 


(water) 
ALLIGATOR 


(air) 
BIRD 


(whit«) 


COW 


FISH 


TURKEY 


(blue) 


SQUIRREL 


SEAL 


OWL 


(yellow) 


LION 


FROG 


DUCK 


Reasons : 




Comments: 





I. 

2. 
3. 
4. 
5. 
6. 



Centering? 

Y / N 



Syncretic? 
Y / N 



Post-hoc reasons? 
Y / N 



Difficulty understanding? 
Y / N 
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S.O.R.T.S. page 2 NAME 

Sort 3 

(grow) (noise) (furniture) (transportation) (abodes) 

(red) FLOWER HORN DESK BOAT TEEPEE 

(white) LEAF WHISTLE ^TABLE PLANE BIRDHOUSE 

(blue) BANANA ^ DRUM CHAIR BUS BARN 

(yellow) CORN BELL BED BIKE HOUSE 

Recall : (Include all responses In order) 

1. 11. 

2. 12. 

3. 13. 
^. lA. 

5. 15. 

6. 16. 

7. 17. 

8. 18. 

9. 19. 
10. 20. 

Reasons ; Cowmen ts: 



1. 
2. 
3. 
U. 
5. 
b. 
7. 
8. 
9. 
10. 



Centering? Syncretic? Post-hoc reasons? Difficulty understanding? 

Y/N Y/N Y/N Y/K 



S.O.R.T.S. Scoring Sheet: Page 3 



NAME 



Keasona for conatralned (experimenter's groups: 



1, (grow)_ 

2. (noise) 



3. (furniture) 
A. (vehicles) 



3. (habitacs) 



RECALL #2: 

1. 11. 

2. 12. 

3. 13. 

4. 14. 

5. 15. 

6. 16. 

7. 17. 

». 18. 

9. 19. 

10. 20. 



Connents: 
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S.O.R.T.S. CODING KEY 



In scoring the sorts made by children, the following crltotl* 
for •sslgnlng levels to each group are to be followed. Each group 
wade Is to be coded with two numbers: the first number corresponds 
to the coded level appropriate to the type of sort the child made, 
and the second number indicates the number of Items the child put 
into that group. 

Thus, if the child put three red animals together in one group, 
and gave as a reason, "because they're the same color", his coded 

score for that group would be _2 3_ (the 2 indicating a lev^l 2, 

or perceptual group, and the 3 indicating three items in the group). 

Three factors must be taken into account in determining the 
level for each group: 

1) the actual group made, indicated by the numbers in the sorting 
matrix. 

2) the reason given by the child for that particular group, 

3) the examiner's judgment as to the child's reasons, as indicated 
in his marking of syncretic or post-hoc reasons, and in his 
written comments, if different from the child's stated reasons. 

Cenearlly, should a discrepancy arise between these three 
factors, greater weight is given to the combination of the S's 
actual group and the E's judgments, rather than relying on possibly 
imprecise verbal reports of the S. 

The numbers in the column on the left of the page indicate the 
level to be assigned items in groups corresponding to reasons based 
on the criteria specified in the text on the right. In case of a 
clear discrepancy of more than one level on any given group, which 
cannot be resolved by a specifiable criterion on the coding key, a 
compromise to the level between the two levels which are discrepant 
is appropriate. But this composmise should be noted for subsequent 
interrater discussion. 



55 

S.O.R.T.S. CODING KEY 
LEVELS 

No strategy apparent (syncretic) 

all cards in one or two groups, with no reasons 

Cards grouped by spatial contiguity 

Made design (e.g., put cards In form of letter E) 

Inferred no strategy, based on far-fetched reasons and lack of 
correspondence with actual group made (often this is the case 
with post-hoc reasons) 

Sort based on color differences 

Sort based on color similarities 

Sort based on phonetic similarities 

Sort based on shape of card 

Dysj unction, either related or unrelated, but treated separately, 
as in centering (e.g., "this one has , and this one has 



Postural: they are both sitting. 

Shape of the item (e.g., they are both long) 

Edge matching each item to the one next to it by association, 
but with no association for the group as a whole. 

They have (noun) (e.g., legs, mouth, etc.) 

They (verb) (e.g.. fly, walk, etc.) IN PAIRS. 

Overinclusive groups (e.g., 8 items in group called 'animals') 

Multiple groupings: "these two in water, these two swim," 
but with no connection between groups. 

Idiosyncratic associations: (e.g., drum with teepee, bicycle with 
bell, birdhouse with leaf...) 

They could be (pets, toys, etc.. Implying idiosyncratic label). 

Two items by location with one dysjunctive (Inappropriate) in a 
group of three items (e.g., these two are in the jungle, and 
there is also a seal) 



S.O.R.T.S. CODING KEY: LEVELS CONTINUED 
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4 

4 
4 
4 

4 
4 

5 

5 
5 
5 



Key rtng: several Items go togecher because they are all 
associated with one Item within the group (e.g.» 'these go 
in the house') 

Association by location IN PAIRS (if Identif icatory) 
Association by function IN PAIRS 

Categorical group, but including one or two items which don't 
fit the category 

They (verb) . with THREE OR MORE in group 
They are made of (material). (If appropriate). 

Association by location (excepting key rings), with three or 
more items in the group. 

Association by function, with THREE OR MORE in group 
Categorization (e.g., these are furniture) 
They are (label) (e.g.. food), even by pairs. 
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